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Adveztiseaant Monitoring And Feedback System 



ZfudkfsmxA of Invontion 

5 Cable television service providere have typically provided 

one-way broadoaet aezvlces but now offer high-speed data 
services and can ci»dt>lne traditional analog hroadcaste with 
digital broadcasta and aocesa to Internet web sites. Telephone 
companies can offer digital data and video programming on a 
10 switched basis over digital subscriber line technology. 

Although the subscriber may only be presented with one channel 
at a time, channel ohaTige requesta axe inatantaneously 
transmitted to centralized switching equipment and the 
subscriber can access the prograiralng in a broadcaah-aike 

15 manner. Internet Service Providers (ISPs) offer Internet 
access and can offer access to text, audio, and video 
programming which can also be delivered in a broadcast- like 
manner in which the subscriber selects '^channels" containing 
programming of interest • Such channels may be offered as paxt 

20 of a video programming service or within a data service and can 
be presented within an Internet browser. 

Advertisements axe a part of daily life and certainly an 
in(>ortant part of entertainment programming/ where the payments 
for advertisements cover the oost of network television. A 

25 method, which provides a flexible billing plan to cable network 
usere based on the amount of advertiaeinents viewed is described 
in U.S. Patent No. 5,532,735, which diecloeee a method of 
advertisement selection for intexaotive services. A user 
associated with an interactive TV is presented with a program 

30 and a set of advertisements. The user can indicate the amount 
of advertisements in the set of advertieemente he wants to 
view. 

While advertisements are sometimes be&efioial to 
eubscribera and deliver desired infonnation regarding specific 

1 
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producta or services, conaumere generally view advertising as a- 
^necessary evil" for broadcast- type entectaiiment. For 
example, a method for obtaining information on advertised 
services or producta is described in U.S. Patent No. 5,708,478, 
5 which discloaas a eoaputer eystem for enabling radio listeners 
and television watchers to obtain advertising information, the 
system detemdnes whether an incoming video or audio signal 
includes advertisement specifio -data for an advertiser arid 
captures and etores the advertiser specific data. 
10 Manufaatuiers pay an extremely high price to present, in 

30 seconds or less, an advertisement for their product, which 
they hope a consumer will watch. Unfortunately for the 
aanufacturer, the consujaer frequently uses that interval of 
time to check the progran«dng being presented on other 
15 channels, and may not watch any of the advertisement. 

Alternately, the consumer may mute the channel and ignore what 
the manufacturer has presented. In any case the probability 
that the consumer has watdhed-the advertisement is quite low. 
It is not until millions of dollars have been spent on an 
20 advertising campaign that a manufacturer can determine that the 
ads have been effective.. This is presently accomplished by 
monitoring sales of the product or TV programs or channels 
viewed by users as disclosed in various public documents. As 
an example, U.s/ Patent No. 4,546,382 disdoees a television 
25 and marlcet research data oolleotion system and method. A data 
collection unit containing a rnemory stores data as to which of 
the plurality of TV modes are in use, which TV channel is being 
viewed as well as input from a suitable optical scanning device 
for collecting information about the user's product purchases. 
30. toother system described in O.S. Patent So. 4,258,3B6 disolosea 
a television audience measuring system. The aystpm inonitors 
and stores information representative of channel 
identification, the time at which the channel ia selected and 
the time at which the selection of a channel is terminated. 

2 

» 

5/4/05, EAST Version: 2-0.1.4 



WOOl/65747 PCT/O801/06459 
O.S. Patent No. 5r608|445 dlecLoses a method and d^ice for 
data capture in televlaioti viewer reseaxoh. Devioea are 
attached to a' video inetallation in order to detondnd to which 
channel a set is tuned. 

5 With the advent of the Internet # manufacturers and service 

providers have found waya to eeleetively Inaert their 
advertisements baaed on a aubsorlbera requests for information. 
As an example, an individual who seaxchBs for ^oars" on the 
Internet may see an advertisement for a particular type of par, 

10 Various internet-baBfed advertisers use this method ♦ The 
product literature from lUGtS Inc.,'' Ad Force,'' printed from 
the World Wide Web site 

http; //www. starpt.coni/core/ad^Target. html on June 30i 1998 
disclosee an ad targeting system. The system delivers ads to 

15 web site visiters based on the content of the web page, time of 
dayr day of the week, keyword, by tlie number of timea a visitor 
sees an advertleemeot and by the order in which a series of 
advertisements are shown to a visitor, nevertheless, unless 
the subscriber actually goes to the advertised web site, there 

20 is no way to determine if the advertisement has been watched. 
Ab the content on the Internet migrates to multimedia 
programming including audio and video, the costs for the 
advertising will Increaee, but unless the advertiser can be 
sure that a significant percentage of the message was watched 

25 or observed, the advertising is. ineffective* Prior art 

products for generating reports of ad canpaigne are generally 
PC-'centric as described in various product literature which 
include the product literature £t<m DoubleClicIc Inc., 
"DoubleClicX: Reporting/^ printed from the World Wide Meb (WWW) 

30 site http://www.doubleclick.net/dart/howi_repo.htm on June 19, 
1998, which discloses the reporting capabilities of 
Doubleclick's Dynamic Advertising Reporting & Targeting (DART) 
product. The information in the reports includes daily 
impressions by advertisement type, average iinpreesion per day 

3 
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ot week and by hour of day. The avexage reaponee rate pet user 
is also included in the reports. The product literature from 
Netgravity Inc. *AdSexver 3," printed from the World Wide Meb 
site http://w«w.netgravity.ooni/producta/ on July 9, 1998 
5 dieolosefi Uetgravity'a Adserver 3 product for online 

advertisement. The product generates reports including the 
profiles oC visitors who viewed an ad and site traffic 
throughout the day, week, n»nth and year. 

The product literature from Media Metrlx *Fte^ently Aeked 
10 Questions', printed from the World Hide Web site 

http://MWW.mediaraetrix.cQin/ioteract_inffifaq.htm oh June 30, 1998 
diaolosee Media Metrix'a eoftware, «PC Meter% that runs in the 
background of a PC and monitors everything being done on that 
machine. It determioea who U uaing the PC by age, income, 
15 gender and geographic region and tracks usage of software 
- application, oonnercial online services and detailed page level 
viewing of the World Wide Heb, The marketing literature from 
Matchlogtc Inc., *Centrallz6d Ad Management, « printed from the 

World Wide Web aite 
20 http://www.matohIogic.con/docB/Bervices2.htm on Jttly 1, 199B 

discloses Matchlogie services for ad management. The services 
include delivering advertisements based on pre-defined 
targeting criteria, generating reports on how many unique 
viewers saw which banner and how many times it was viewed. The 
25 product literature from ftooipiter Inc.* Aociplter Mtenager 
2.0," printed from the World «ide Web site 
http://www.accipiter.com/products/ADManager/fab.html on July S, 

1990 discloses Accipiter's ad management system. After 
delivering an advertiaement based on pre-defined criteria, the 
30 system can generate reports on an ad oampalgn. The reports 
, include visitors' demographic data, number of impressione and 
clicks generated from the entire site and by each a4 and 
advertiser. 



4 
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In orU«r to deliver more targeted prograitimiTvg and 
advertising to siibscribers, it ie necessary to underetand tbetx 
llJces and dislikes to a greater extent than is presently done 
today. Syetema whidi Identify subsoriber pcefexences based on 

5 their purchases and reeponaea to questionnaires allow for the 
targeted marketing of literature in the mail, but do not in any 
sense allow for the rapid and precise delivery of prograraming 
and advertising which is known to have a high probat>llity of 
acceptance to the subsoriber. Other systems give veers the 

10 possibility to choose their programming as described in D.s. 
Patent No. 5,223,924 which discloses a system and method for 
automatically correlating user preferences with a TV program 
information database. The system includes a processor that 

* 

performe ^'free text'' search techniques to correlate the 
IS downloaded TV program information with the viewer^ e 

preferences. This system requires an interaction Jbetween the 
users and the progxaxnming, The white paper from Uet 
Percepticna corporation entitled ""Adding Value in the Digital 
Age" and printed from the World Wide Web site 
. 20 http;//wwwinetperceptionefCoro/productB/white-papers.htna on • 

June 30/ 1998 discloses how the GroupLeng Recomiticndation Engine 
gives online bueineaees the ability to target and personalize 
servicea, content, products and advertising, A learning 
process learns pereottal information about an individual using 
25 explicit and implicit ratings, -a prediction process predicts 
user preference ualiig collaborative filtering and tbe 
recoiimendation process recommenda producta or aecvioea to uaera 
based on predictiona^ 

The product literature from Aptex Software Inc*, 
30 ^'SeleotCast for Commerce Servers printed from tbe World Wide 
neb site http://ww.dptex.com/pcoducta-56lectcast-commerce.htm 
on i3\me 30/ 1998 describee the product ''SelectCa^t^ for 
Commerce Servers. It personalizes online shopping baaed on 
observed user behavior. Oeer interests are learned based on 

5 
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the content they browse, the promotions they click and thb 
products they purchase « 

In order to determine which prograaanlag or advertising ia 
appropriate for the eubaoritoer, knowledge of that subscriber 
5 and the subscriber product and prograjwiing preferencea ia 
required. Different methods ace being used to gain knowledge 
of user's preferences and to profile the users. Generally, 
these methods use content or data mining technologies to 
profile users or predict their preferences. Another technique 
10 for predicting user's preferences is based on the use of 
collaborative filtering as described in U.S. Patent No. 
5,704,01? which discloses a collaborative filtering system 
utilizing a belief network. The system learns a belief network 
• using prior knowledge obtained from an expert In a given field 
15 of decision making, and a database containing empirical data 
such as usera' attributes as well as their preferences in that 
decision making field. The belief network can determine the 
probability of the unknown preferences of the user given the 
known attributes and thus predicts the preference most likely 
20 to be desired by the user. 

The product literature from Aptex software Inc. , 
^SelectCast for Ad Servers,* printed from the World wide Web 
site httpi//www.aptex.oom/produota-s6leotoast-ads.htm on June 
30, 1998 discloses an ad targeting system from Aptex Software 
25 Inc. The system eaploys neural "networks and a context vector 
data model to optimize rel&tlonshlpe between users and content. 
It provides user profiling by mining the conteatt and content of 
all actions including clicks, queries, page views and ad 
iiopreseions. Aptex' e technology uses a context vector data 
raodeling technique described in U.S. Patent Ko. 5,619,709 which 
discloses a system and method of context vector generation and 
retrieval. Ctontext vector a represent conceptual relationships 
among information items by quantitative means. A neural 
network operates on a training corpus of records to develop 



30 
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relationahip-based context veotora based on word proximity and 
co-import dhoe« Geometric relationshlpe among context vectors 
axe reprosentative of ooDoeptual relationahlps among their 
associated items. 

The product data sheet from Open Sesamei ^Leam Sesame,'^ 
printed ixm the World Ride Web site 
http;//www,opense8ame.com/prod^04,htinl on iJuly 09^ 1998 
discloses Open Sesame' s personalization product for Web 
enterprises t It learns about \;isers automatically from their 
browsing behavior* 

The product literature from Bagage Technologies/ 
""Engage.Disooverr"^ printed from the World Wide Web site 
http://wwv.engagetecb.com on July 09 ^ 1998 discloses Engage 
Technologiee' product for user profiling. User-disclosed 
information auch ae interest, demographics and opinions are 
coitibined with anonyraouB clickatream data that describes where 
users come from before visiting the site ^ how long they stay, 
and what pages or types of pages they visit most frequently to 
build the visitor profile. 

The marketing literature from BroadVision^ ^The Power of 
Pej:sonalization''f printed from the World Wide Web site 
http://www*broadvision.cam/content/corporate/brochuro/8rooh4*ht 
m on August 21, 1998 discloses the BroadVision One-to-One • • 
application profiling system. The system learns about users 
through a variety of techniqueei including registration, 
questionnaires, observation and Integration of hiatorical and 
externally generated data. 

The martoting literature from the Firefly Corporation, 
^Firefly Passport Office," printed from the WorW Wide Web site 
http://www«ficefly.nBt/coiqpany/PaBBportOf fioe.html on June 20, 
1998 discloses Firefly's Relationship Management software. The 
software enables online buslneseea to oreabe, extend and manage 
personal profiles for every user. 

7 
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Specific tftformation rogatdlng a subscriber' e viewing 
habits or the Xnbernet web sites they have acceased caft be 
stored for aoalysie, but such records are conaidered private 
and eubsoribere are not genexaUy willing to have such 
5 information leave their control. Although there are regulatory 
modele/ which permit the collection of such data on a "notice 
and consent* basis, there is a general tendency towards legal 
rules, which pcohibit such raw data from being collected. 
With the migration of services from a broadcast based 
10 model to a client-server based model in which subscribers make 
individualixed recpjeste for pxogtsnaidng to an Internet aooese 
provider or content provider, there is opportunity to monitor 
the subscriber vleving characteristics" to better provide them 
with programming and advertising which will be of interest to 
15 them, A server may act as a proxy for the subscriber requests, 
and thus be able to monitor what a subscriber has requested and 
is viewing. Since subscribers may not want this raw data to be 
utilized, there is a need for a system which can process this 
information and generate statistically relevant subscriber 
20 profiles. These profiles should be accessible to others on the 
network who may wish to determine if their programming or 
advertisements are suitable for the auhscriber. In a 
broadcast-based model, the information to be processed can be 
embedded within the TV program or broadcast separately and can 
25 be in the form of an electronic 'program guide (BPQ) or text 

information related to the program. As an exarnple, U.S. Patent 
No. 5, 57$, 055 discloses an eleotronio program guide (BPG) and a 
text channel data controller. The text and BPG data are 
embedded in the vertical blanking interval of the video signal 
30 and extracted, at reception, by the data controller. The BPS 
contains Information fielda such as program category, program 
subcategory and program content description. 0.9. Patent No. 
5,596,373 discloses also a method and apparatus for providing 
program oriented Information in a multiple station broadcasting 

8 
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system. The EPG data includes guide datar ohannel data and 
program data. The program data included among other 
inforniatlonr the program title, the program category, the 
program aob-category and a detailed description of the program. 
5 Some efforts have been made to transmit targeted 

advertisements and thereupon collect feedbacX on the 
tranemitted advertisements. For example, U.S. Patent 
No. 5/ 948/061 provides methods and apparatuses for targeting the 
delivery of advertisements over a network such as the Internet. 
10 Statistica are ceiled on individual ueera and networka and 
the yxsB of the advertisements is tracked to permit targeting of 
the advertisements to individual users. In response to 
requests from affiliated sites, an advertising server transmits 
to people acceBsing the page of a site an appropriate cne of 
15 the advertisements based upon profiling of uaers and networks. 

Furthermore, U.S. Patent No, 6,005rS97 provides a method 
and apparatus for television program selection that monitors 
the v-iewing preferences of a viewer to create a dynamic viewer 
profile that is used to rate available programs. Based on the 
20 viewer profile, available programs are sorted and presented to 
the viewer in descending order of predicted interest. The 
invention allowa a Viewer to quickly find the program of 
greatest interest to the viewer without having to tediously 
search through large Dumbers of available programs. The 
25 invention maiy also be used for.eelecting from among a plurality 
of programs other than television programs, such as, for 
exanple, radio programs or audio or video programs stored on 
digital storage media such as CD's and DVO's. 

a.S. Patent Ho. 5,446,919 provides a communication system 
30 capable of targeting a demographlcally or psychographioally 
defined audience, h master database is maintained, containing 
demographic and psydiographic information about eadi audience 
member. Shis information is transmitted and stored in a 
channel select ion/deooder unit associated with each audience 
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member's receiver. Multiple media meaflagee are transmitted to 
eaoh audience aeober. Aocoapanying the transadaeion is a 
seleotion profile command, which details the 
demographic/peychographic profile of audience members that axe 
5 to receive each media massage. The channel selector/decoder 
unit associated with eaoh member's receiver compares the 
selection profile with the demographic/psyohographic 
information about the audience merober and selects the 
appr^riate media measage for that audience uember. 
10 U.S. latent Mos. 5,^^1,735 and 5,848,39$ disclose a 

computer aetWork method aftd apparatos which provides targeting 
of an appropriate audience based on peychogcaphic or behavioral 
profiles of end users. The psycbographic •profile is formed by 
recording conputer activity and viewing habits of the end user. 
15 Content of categories of interest and display format in each 
category are revealed by the psyohographic profile, based on 
user viewing of agate information. Using the profile (with or 
without additional user demographiosl , advertisements are 
displayed to appropriately selected users. Baaed on regression 
20 analysis of recorded reaponses of a first set of users viewing 
the advertisements/ the target aaer profile is refined. 
Viewing by and regression analysis of recorded responses of 
subsequent sets of users continually auto-targets and 
customises ads for the optimal end user audience. 
25 U.S. Patent No. 5,155,591 p'rovides e functionality where 

different oommerolal mesaagee are broadcast to different 
demograpblcally targeted audiences in a cable television system 
or the like. A first television channel contains television 
programs and periodic commercial messages. A second television 
30 channel contains alternate commercial meesages. Demographic 
characteristics of a viewer are identified, and commercial 
jnessages are selectively provided from the first or second 
channel, depending upon the viewer's demographic 
'characteristics. Demographic data can be Input by a viewer via 

10 
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a remote control, dovnloadedt to a svib8criber*e converter £rom a 
remote head-endi or prograinmed into tlie converter at 
Inetallation. Prioritization of the demographic 
characteristics of a plurality of television viewers watching a 
5 program together enables conmeroials to be targeted to the 
viewer having highest priority. Statistical data can be 
maintained concerning the number and identity of subscribers 
viewing specific commercials. 

U.S. Patent No* 5,774/170 enhances television (and radio) 
10 advertising by targeting, delivering and displaying electronic 
advertising messages (commerQials) within specified programming 
in one or more pre-determined households (or on specific 
display devices) while simultaneously preventing a oomn^rcial 
from being displayed in other households or on other displays 
15 for which it is not intended. Ccainmerciala can be delivered to 
specified homes or displays via either over-the-air or wired 
delivery systems. 

O.Sr Patent No. 5r 446, 919 provides a communication system 
capable of targeting a deraographically or psyahographloally 
20 defined audience. A master databaae is maintained, containing 
demographic and psychographic information about each audience 
member. This information is transmitted and stored in a 
channel selection /decoder unit associated with each audience 
member *s receiver. Multiple media messages are transmitted to 
25 each audience mambar. Accompaaying the transmission is a 
selection profile command, which details the 
demographlc/psycbographic profile of audience members that are 
to receive each media message. The channel selector/decoder 
unit assooiated with each member receiver empires the 
30 selection profile with the demographic/psychographio 
information about the audience member and selects the 
appropriate media message for that audience member. 

IEEE Publication: Tramawork f or Targeting Banner 
Advertising on the Internet" by Gallagher and J» j^aredns, 

11 
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Jan. 1997, presents a ffiodel fox effectively and efficiently 
targeting hypermedia-based banner advertieementa in an online 
information eervioe. The nodel takes advantage of information 
technology to micro-target banner advertisements based on 
5 individual characteristics of users. 

O.S. Patent No. 5,636/34$ provides a method and system for 
selectively targeting advertisements and prograjtwiing to 
different demogcaphically and specially targeted television 
audiences by relating carrier subscriber data to other 
10 prcprietary marketing databases by creating, compiling and 

updating a National Diraotory of cable and other carrier system 
sttbseriber names and address information derived from actual 
cable system and telephone company hilling records. 

The above-mentioned systems and methods provide many 
15 different ways to select and deliver targeted advertisements. 
However, these ayatema lack the means for monitoring displayed 
advertisements and collaoting feedback. Such monitoring and 
feedback systenia are typically not available in television 
environments . 

20 For the foregoing reaeoQB, there is a need for an 

advertisement monitoring and feedback system that may monitor 
advertisements that have been viewed by a subscriber and 
provide feedback to a subscriber characterisation system vhich 
may generate one or more subscriber profiles that incorporate 

25 advertising related information. Such subscriber profiles nay 
assist advertisers In determining the success rates of the 
advertisements being broadoast and accordingly advertisers may 
allocate financial sources on the advertisements that are 
likely to succeed in getting the attention of the subscribers . 



30 



Suamery of thA Invention 

The present invention encoa5)aBaes an advertisenent 
monitoring system that determines to what extent an 
advertisement has been viewed by a subscriber or a household 
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and generates one or more records of the subscriber advertising 
deiaction data, Id a preferred etnbodiment, the sidjecriber 
advertising selection data Inoludea the channel selected and 
the time at which the chaimel vae selected. Advertisement 
5 related information including the type of product, brand name, 
and other descriptive Information that categorizes the 
advertisement is also extracted and added to the advertising 
selection data. The advertisement related information might 
also be ertr acted frcaa the closed-captloning teact. Based on 
10 this advertisement selection data, a record is created 

documenting what percentage/ if any, of the advertisement was 
watched. This record is- then fed back to the subscriber 
characterization system, wherein the subscriber 
characterization system roay comprise one or more filters. 
IS The subscriber character! aation system also monitors the 

subBcxiber viewing habits associated with program viewing and 
generates one or more records of program selection choices* 
The program selection choices include the viewing time 
duration^ number of channel changes/ volume at which the 
20 programming is listened^ program selection^ and text 

information about the prograiMing. The records are vised to 
determine what type of programming the subscriber is most 
interested in. The subscriber characterization system 
characterises aubscribere based on feedback information from an 
25 advertisement monitoring system, and monitors their detailed 
program viewing selections. 

Furthermore, the subscriber characterixation system is 
equipped with one or more filters that aBslat in deterxnining 
and eliminating from conslderationf selection data associated 
30 with irrelevant activities by the subscriber. Exanqples of 
Irrelevant activities include aeleotion data associated with 
channel surfing and/or channel Jumping (up and down) 
activities* 

The channel surfing activity refers to one or more rapid 
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cbaonel changee Initiated by the subacirlbdr fox the purpoda of 
selecting a channel/program for actual viewing. Generally, the 
stibecrlber aelect& a channel/ and views the contents of the 
program at the selected channel for a few seconds (about 3-4 
5 seconds) r and then changes the channel to view the contents of 
the next channel. Such rapid changes generally occur a few. 
times in a row before the subscriber selects a 
channel /programming for actual viewing • The filters of the 
present Invention are configured to delect channel surfing 
10 aotivltlee by the subscriber by monitoring and evaluating 
associated viewing times/ The channel surfing activities are 
filtered out and thus not considered in. the detendnation of 
actual viewing selections. 

The channel jumping refers to an activity wherein the 
15 subscriber changes channels very rapidly in order to move from 
an existing dtiannel to a desired channel. Therein/ the 
subscriber is not channel surfing, instead the subscriber 
already knows th6 intended c^annel/progxam for actual viewing 
and is jumping channels to reach the desired channels. For 
20 example, if the subscriber is at channel number 6, and wants to 
go to channel nuznber 12, the subscriber may junp the channel by 
changing the channel six times. Generally, in channel juii^lng, 
the channel chaoges occur very rapidly and the viewing time at 
the each channel is very brief, e.g., lees than one second. 
25 The filters of the present Invention are configured to detect 
and filter out channel jumping. Thus, the channel jumping 
activitiee are not considered in the determination of actual 
viewing selections. 

The filters of the present invention are also capable of 
3Q monitoring extended spans of inactivity! e*g., a lack of any 
channel changes, volume changes, or any other selection changes 
activity for more than 3 hours. Such spans of inactivity are 
considered ''dead periods'' implying that the subscriber is not 
actively watching the video and/or other multimedia 

14 
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progreonraing. The reasons for such dead periods may be caueed 
by the f apt that the gubscriber has le£t the rown, or the 
dubsoxiber is not active (e.g.r the aubecriber has gone to 
sleep or haa doxed off), or the fact that the subscriber is 

5 actively engaging io another activity within the room and ia 
not attending to the prograsiming. 

The subscriber characterization system of the present 
invention analyzes the actual viewing selections made by the 
subscriber or the subscriber household r and generates a 

10 demographic description of the subscriber or household. This 
demographic description describes the probable age, inoomei 
gender and other demographics. The resulting characterization 
includes probabilistic determinatione of what other prograioraing 
or products in which the subscriber/household will be 

15 intere5ted. 

In a preferred embodiment, the text informatioji related to 
the advertisement ia processed using context mining techniques 
which allow for classification of the advertisement and 
extraction of key data including product type and brand. 

20 Context mining techniques allow for detenrdnation of a pwduct 
type, product brand nait« and in the case of a product which is 
not sold with a particular brand iiamer a generic name for the 
products 

The present invention can also be realized in a olient- 
25 server mode in which case the advertising related information 
is collected at the client side of the network and is then 
transmitted to the server side via a secure connection. The 
server side then incorporates this information with other 
subscribsr information to create subscriber profiles, 
30 These and other features and objects of the invention will 

be more fully understood from the following detailed 
description of the preferred embodiments which should be read 
in light of the accompanying drawings, 

IS 
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Brief DttMrl^tioA o£ tha Orawing^ 

The aooorapanying drawinga, which are incoiporated In and 
fom a part of the apeciflcation, illustrate the ejnboditctenta of 
the present invention and,, together with the desoription serve 
5 to explain the principles of th» invention. 
In the drawings: 

TIQ. IK illustratea a context diagram for an advertising 
monitoring and feedback aystem (ahps), in accordance with one 
embodiiaent of the present invention; 
10 FI6« IB illuBtratea ^ context diagram for an advertising 

mbnltoring system (AHS), in aooord^x^ce with one embodiment of 
the preeent invention; 

FI6. IC IHuetrabeB a context diagram for a subscriber 
characterization ayetem with filters (SCSr) / in accordance with 
15 one embodiment of the present invention; 

FIG. ID illuatratea a functional diagram of the prooeasing 
utilized by the filters; 

FIG. 2 illttstrates a block diagram for a realization of a 
subecxiber monitoring system for receiving video signals; 
20 FIG. 3 illustrated a block diagrain of a channel processor; 

FIG. 4 illustrates .a block diagram of a cciqputer for a 
realization of the advertisement monitoring system; 

FIG. 5 illustrated a channel sequence and volume over a 
twenty-four (24) hour period; 
25 FIG. 6A illustrates a time of day detailed record; 

FIG. 6B illuatratea the processing utilized to determine 
channel surfing activities; 

PIG. 6C illuatratea the processing utilized by filters to 
determine channel- jumping activities; 
30 FIG. 7 illustrates a household viewing habits statistical 

table; 

FIG. 8A illustrates an entity-relationship diagram for the 
generation of program characteristics vectors; 

16 

5/4/05, EAST version: 2.0-1.4 



wo 01/65747 PCl/USDWl64a9 

FIG. BB llludtrates a flowchart for program 
characterization; 

FIGS, 9A llluatrateB a determlDlstio program category 
vector; 

5 FI6» 9B illustrataa a detertaiDlatiu program sub-category 

vector; 

FIO« 90 llluatratea a determiBletlc program rating vector; 
FIG. 9D lllii3trateB a probabilistlo program category 
vector; 

10 FIG* 9B ilittstratea a probabilistic program aub-category 

vector; 

FIG. 9F lllustrataa a probabilistic program content 
vector/ 

FIG. lOA illustrates a set of logical heurietic rules; 
15 FIG. lOB illustrates a set of heuristic rules expressed in 

terms of conditional probabilities; 

FIG, 11 illustrates an entity-relationship diagram for the 
generation of ♦program demographic vectors; 

FIG, 12 illuetratea a program demographic vector; 
20 FIG. 13 Illustrates an entity-relationship diagram for the 

generation of houeehold session demographic data and household 
session interest profiles; 

FIG. 14 illustrates an entity-relationship diagram for the 
generation of average and session household demographic 
25 characteristics; 

FIG* 15 illustrates average and session houaehold 
demographic data; 

FIG. 16 illustrates an entity^relationehip diagram for 
generation of a household Interest profile; 
3D FIG* 17 illustrates a household interest profile including 

programming and product profiles; 

FIG. 18 illustrates a client-server architecture for 
realizing the present invention; and 

FIG. 19 illustrates an advertisement monitoring table, 
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0tttAil«4 DAseriptioa 
Of Vh« Pzafarzad Xn^diowat 

In d« scribing a jureferxed embodiaent of the invent loo 
5 illustrated in the drawings, specific terminology will be used 
for the sake of olatity. However, the invention is not 
intended to be limited to the apeclflc tersna so selected, and 
it is to be under stood that each epeoific tend includes all 
technical equivalents which operate in a similar manner to 
10 aocompllsh a sisdlax purpose. 

Kith reference to the drawings, in general, and FIGS. 1 
through 19 in particular, the apparatus of the present 
invention ie disclosed, 

pio. lA illustrates a context diagram of a preferred 
15 embodiment of an Advertising Monitoring and Feedback System 
(AMF8) 100. The AMPS 100 coioprlees an advertising monitoring 
system (WIS) 102 and a subscriber- characterisation system with 
filters (SCSF) 104 . A. context diagram, in combination with 
entity- relationship diagrams/ provide a basis from which one 
20 skilled in the art can reali*e the present invention. The 
.present invention can be realised in a nuaiber of programming 
languages including C, C++, Perl, and Java, although the scope 
of the invention is not limited by the choice of a particular 
programming language «t tool. Object oriented languages have 
25 several advantages in terns of construction of the software 
used to realize the present invention, although tbe present 
Invention can be resliied in procedural or other types of 
prograiming languages known to those skilled in tbe art. 
Within the AMPS 100, the MS 102 moaitors subscriber 
30 advertising viewing activities, processes them, and generates 
advertising selection data. The AMS 102 then forwards the 
advertising selection data to the SCSF 104 which further 
processes the advertising related information received from tbe 
AH8 102. The SCSF 104 also monitors subscriber viewing habits 
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as they relate to actual progcatmning lAfonnation* SCSF 104^ 
based on advertiaing related information and the actual, 
progrannning information, generates one or xnore subscriber 
profiles 106r wherein each subsoribex profile indicates a 
5 probabilistic measure of subscriber demographics and/or 
preferences. 

As illustrated in FIG. IBr in generating one or ntore 
records of advertisement selections, the AMS 1D2 receives from 
a subaoriber 120A cosanands in the form of a volume control 

10 signal 124A or advertising selection data 122A which can be in 
the form of a channel change, The advertising material being 
viewed by the subscriber 120A is referred to as source jnaterial 
130A. The source material 130A, aa defined hereinr is the 
content that a subscriber selects and my consist of analog . 

15 video, Motion Picture Expert Group (MPEG) digital video source 
ttiaterlalf other digital or analog material, Hypertext Markup 
Language (HTML) or other type of multimedia source ipaterial. 
The AMS 102 can access the source material 130A received by the 
eubscriber 120A using a start signal 132A and a stop signal 

20 134A, vhich control the transfer of source related text 136A 
vhich can be analyzed as described herein. 

In a preferred enibodimentr the source related text 136A 
can be extracted from the source material 130A and stored in 
memory. The source related text 136A, aa defined herein, 

25 includes source relat<^ textual: information including 

descriptive fields' which are related to the source material 
• 130A, or tent which is part of the source material 130A itself. 
The source related text 136A can be derived from a nuniber of 
sources including but not limited to closed-captioning 

30 informationr Electronic Program Guide (BPQ) materialf and text 
information in the source itself (e.g. text in HTML files). 

An Electronic Program Guide (BPG) 140A contains 
information related to the source material 130A which is useful 
to the subscriber 120A. The EPG 140A is typically a 
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aavigatlonal tool which eontaing source related informationr 
incltadlng but not limited to, the programming categoryr program 
description, rating, actors, and duration. The structure and 
content of EP6 data is dd scribed In detail In US Patent 
5 5^596,373 assigned to Sony Corporation and Sony Electronics* 
The BP6 140A cen be deceased by the MS 102 by a request BP6 
data signal 142A which results in the return of a category 
144A, a sub-category UGk, and a general advertisement (ad) 
description 148A» The EP6 140A can potentially include fields 
10 related to advertising, in one esibodlnient of Oie present 
invention, the EPG infonoation such as the category 144A| the 
sub-category 14€A, and the general advertisement description 
146A are stored in a memory. 

In another embodiment of the present invent ion^ the source 
15 related text 136A Is the closed-captloning text embedded in the 
analog ^or digital video signal. Such closed-captioning text 
can be stored in a memory for procesBlng to extract the 
advertising characteristics related information. 

One of the functions of the AMS 102 is to generate one or 
20 more records of advertisement selections llOA which are 
comprised of advertising characteristics • The advertising 
selsction record llOA may be obtained fr9m the monitored 
activities of the subscriber 120 A and in a preferred embodiment 
can be stored in a dedicated memory. In an alternate 
25 embodiment, the advertlalog selection record UDA may be stored 
in a storage disk. In an exen^lary cascr the information which 
la utilized to form the advertisement selection data llOA 
includes time 112A, uhioh ooxr«Bpondd to the time of an eventr 
diannel ID program ID llfiA, volume level ll^K, channel 

30 change recoxd 119A, end advertising title 117A. The AHS 102 
forwards the advertieing- selection krecorda llOA to the SCBP 104 
for further proeesaing and for generating stibscriber profiles. 

710. IC deplots the context diagram of a preferred 
enibodiment of the 80SF 104. 

20 
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In the pxDcees of oollectlng raw stibdcriber selection 
data, the SCSF 104 receives from a subecriber 120B conmande in 
the form of a volume control signal 124B or program eelection 
data 122B which can be in the form of a channel change but may 

5 also be an addrees request which requests the delivery of 
programming from a network address. A record signal 126B 
indicates that the programming or the address of the 
programming is being recorded by the subscriber 1208. !Che 
record signal 12 6B can also be a printing oanmiand, a tape 

10 recording command ^ a bookmark command or any other command 

intended to store the program being viewed, or program address, 
for later use. 

The material being viewed by the subacrlber 120B is 
referred to as source material 130B. The source material 130B, 

15 as defined herein, is the content that a subscriber selects and 
may consist of analog video, digital video such as MPEG digital 
video. Hypertext Markup Language (HTML)r or other types of 
multimedia source material. The SCSF 104 can acxieas the source 
material 130B received by the subscriber 120B using a start 

20 signal 132B and a stop signal 134B# which control the transfer 
of source related text 136B which can be analyzed as described 
herein « 

In a preferred embodinienti the source related text 13 6B 
can be extracted from the source material 13DB and stored in 

25 memory. The source related text 1368, as defined herein, 
includes source related textual information including 
descriptive fields which are related to the source material 
130B, or text which is part of the source material 130B itself. 
The source related text 136B can be derived from a nuniber of 

30 sources Including but not limited to closed- captioning 

information, EP6 material, and text information in the source 
itself (e.g., text in HTML filea) - 

The EPG 14 DB contains Information related to the source 
material 130B which is useful to the subscriber 120B. The EPG 
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140B is typically a navigational tool which contains source 
related infoiroation inoiuding but not limited to the 
programming category, program description, rating, actors, and 
duration. The BPG 140B can be accessed by the SCSF 104 by a 
5 request BPG data signal 142B which results in the return of a 
category 144B, a sub-category 146B, tad a program description 
■ 148B, The EPG data may be stored in memory. 

In another «iibodini6ttt of the present invention, the source 
telated text 136B is the closed-captioning text eaibedded in the 
10 analog or digital vldee signal. Such closed-captioning text 
can be stored in memory for processing to extract character- 
istic vectors 150. 

The SCSF 104 generates one or more program selection 
records 11T)B by monitoring and storing activities of the 
15 subscriber 120B. In an exemplary case, the program selection 
records llOB include time I12B, which corresponds to the time 
of an event, channel ID 114B, program ID 116B, program title 
H7B, volume level 118B, and channel change record 11 9B, A 
detailed record of aelectlon data is illustrated latex. 
20 Generally, the program selection records llOD contain the raw 
data accumulated over a predetermined period of time and relate 
to viewing selections made by the subscriber 120B over the 
predetermined period of time. 

The system of the present invention also comprises one or 
25 more filters 115A, 115B. The filters 115A, 115B evaluate the 
advertisement and program selection data and eliminate any 
eelection data aseociated with irrelevant activities, and in 
turn generate actual subscriber selection data 199 that 
corresponds only to the actual viewing selections made by the 
30 subscriber 120B. The filters 115A, IISB may be a computer 
means or a software module configured with some predetermined 
rules. These predetermined rulee assist in recognizing 
Irrelevant activities and the elimination of the selection data 
from the raw subscriber selection data. In one embodiment, the 

22 



5/4/05, EAST version: 2.0.1.4 



wo 01/^747 rcajmvms9 
selection data assooiated vfith channel surfing, channel jumping 
and dead periods is eliminated from the advertisement and 
program aelectlon data to generate actual aubacriber selection 
data 199. FIG. ID aod the related text describe this proceaa 
5 in detail » 

The actual subaoriber seleotion data 199 comprises time 
112C, which corresponds to the time of an actual viewing event 
exclusive o£ channel surfingr channel junking or dead periods; 
channel ID 114C, program ID 116C, program title volume 

10 level llBCi and channel change record 119C. 

Based on the actual euj^soriber selection data 199, the 
SCSF 104 generates one or more program characteristics vectors 
150 which are comprised of collected chax'acteriBticB data 152. 
The characteristica data 152; which can be used to create the 

15 program characteristics vectors 150, both in vector and table 
form; are examples of source related information which 
represent characteristics of the source material (for the 
advertisements and the programs) . The characteristics vectors 
. 150 are derived from the source related text I3$B and/or from 

20 the BP6 14 OB by applying Information retrieval techniques. The 
details of this proceas are discussed in detail later* 

In a preferred embodiment, the characteristics vectors 150 
are lists of values which characterixc the programming (source) 
material in accordance to the category 14 4B; the sub^category 

25 14 6B; and the program description 14 8B, The present invention 
may also be applied to advertisements; in which case program 
characteristics vectors contain; as an example^ a product 
category; a product sub-category, and a brand name. 

As illustrated in FIQ. IC, the SCSF 104 uses heuristic 

30 rules 160* The heuristic rules 160, as described herein, are 
composed of both logical heuristic rules as well as heuristic 
rules expressed in terms of conditional probabilities. The 
heuristic rales 160 can be accessed by the SCSF 104 via a 
request rules signal 162 which results in the transfer of a 
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copy o£ rules 164 to the BCSF 104. 

The 8CSP 104 al60 forms denographic vectors 170 from 
demographicB data 172. The progcam demosraphic vaotors 170 
also represeAt charaotariatlcs of aouroe related information in 
5 the form of the intended or expected demographlos of the 
audience for which the source material is intended. The 
characteristics vector 150 ia used in coiflbination with the set 
of the heuristic rules 160 to define the demographic vectors 
170. 

10 In a preferred ewbodirnent, household viewing <iata 197 is 

computed from the actual aubacriber selection data 19?. The 
household viewing data 197 is derived from the actual 
subscriber selection data 199 by looking at viewing habits at a 
particular time of day otrer an extended period of time, usually 

15 several days or weeks, and iteking some generalizations 

regarding the viewing habits during that time period. The aCSF 
104 also tranaforms household viewing data 197 to form 
household viewing habits 1^5, i.e. statistical representation 
of Bubsoriber/household viewing data illustrating patterns in 

20 viewing. 

The SCSr 104 generates household profiles including a 
household demographic characteristics 190 and a household 
Interest profile 180. The household demographic 
characteristics 190 resulting from the transfer of household 
25 demographic data 192/ and the household interest profile IBO, 
results from the transfer of houaehold Interests data 182. 
Both the household demographics oharaot eristics 190 and the 
household interest profile 180 have a session value and an 
average value/ as will be discussed herein. 
30 Referring now to WIG. ID, exemplary procesaing of the 

filters lis is shown. As mentioned before, filters IISA and 
filter 115B evaluate the advertiseanent selection data llOA and 
the program selection data llOB to determine any data 
associated with irrelevant selection activities and then 
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generate actual eubecriber delection d^ta 199 whiah does not 
include Irrelev'ant selection data« Tbe irrelevant eeleotion 
data generally corresponds to channel surfing, channel jujqpingr 
or dead periods activities. These activities are generally 

5 recognized by reviewing corresponding viewing times, in the 
case of channel surfing or channel jiunpingf the associated 
viewing times are very brief, a few millieeoonds or a few 
seconds* In the case of dead periods, the viewing tixae is 
relatively long having no actions, e.g., a few hours. 

10 FI6, 2 illustrates an exemplary system for monitoring 

subscriber activttles, Including advertising viewing habits, 
and can be used to realize the AMS 102 and Uie SCSF 104. in a 
preferred ejnbodlment, the nonltoxlng system of PIG. 2 is 
located in a television set-top device or in the television 

15 itself. In an alternate embodiment, the laoait or ing system is 
part of a computer which receives progracnming from a network. 

In an application of the system for television eervices, 
an input connector 220 accepts tbe video signal coming either 
from an antenna, cable television input, or other network. The 

20 video signal can be analog or digital, auch as tfPBG. 

Alternatively, the video source may be a video stream or other 
multimedia stream from a conanunications network including the 
Internet. 

In the case of either analog ox digital video, selected 
25 fields are defined to carry EPQ^data or closed-captioning text. 
For analog vldoor the closed-captioning text is embedded in the 
vertical blanking interval (VBI), As described in OS Patent 
5; 579, 005, assigned to Scientific-Atlanta, Inc., the BPG 
information can be carried in a dedicated channel or embedded 
30 in the VBI. For digital video, the cloaed- captioning text is 
carried as video subscriber bite in a aubeoriber^data field. 
The EPG data is transmitted as ancillary data and is 
multiplexed at the transport layer with the audio and video 
data. 
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Id FIG. 2, a syatem control unit 200 receives ooimanda 
fiotn the subscriber 120, decodes the command and forwards the 
conanaod to the destined module. In a preferred embodiment, the 
commands are entered via a remote control to e remote receiver 
5 205 or a set of seieetion buttons 207 available at the front 
panel of the aystem control unit 200. In an alternate 
embodiment, the subscriber 120 entera the commands via a 
keyboard. 

The system control unit 200 also contains a Central 
10 Processing Onlt (CTO) 203 for processing and supervising all of 
the operations of the system control unit 200, a Read Only 
Memory (ROM) 202 containing the software and fixed data, a 
Random Access Memory (RAM) 204 for etoring data. The CPU 203, 
the RAM 204, the ROM 202, and an input/output I I/O) oontioller 
15 201 are attached to a master bus 206, A power supply in the 
form of a battery can also be included in the system control 
unit 200 for backup in case of power outage. 

The 1/0 controller 201 interfaces the system control unit 
200 with external devices. In a preferred embodiment, the I/O 
20 controller 201 interfaces to the remote receiver 205 and a 

selection button such as the channel change button on a remote 
control. In an alternate embodiment, it can accept input from 
a keyboard or a mouse. 

The program selection data is forwarded to a channel 
25 processor 210. !fhe channel processor 210 tunes to a selected 
channel and the media stream is decomposed into its basic 
components; the video stream, the audio stream, and the data 
stream. The video stream is directed to a video processor 
module 230 where it is decoded and further processed for 
30 display to the TV screen. The audio stream is directed to an 
audio processor 240 for decoding and output to the speakers. 

The data stream can be EPG data, closed-captioning text. 
Extended Deta Service (BD8) information, a combination of 
these, or an alternate type of data. In the case of BDS the 
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call signr program nante aad other useful data are provided. In 
a preferred embodiment, tbe data atzeam is stored in a reserved 
ioaation of the RAM 204. In an alternate embodiinent, a 
magnetic disk ia ueed for data etorage. The system control 
unit 200 writee in a dedicated memory, which in a preferred 
embodiment ia the* RAM 204, tbe selected channeli the time of 
selectionr the volume level and the program ID and the program 
title. Open receiving the program selection data, the new 
selected channel is directed bo the channel proceseor 210 and 
the system control unit 200 writee tp the dedicated memory the 
channel selection end time and the program title at the time of 
channel change. The system control unit 200 Iceeps track of tbe 
number of channel changes occurring during the viewing time via • 
the channel change record* This data forms part of the 
advertising selection records llOA or the programming selection 
records HOB. 

The volume control signal is sent to the audio processor 
240. In a preferred embodiment/ tbe volume level selected by 
the subscribes corresponds to tbe listening volume. In an 
. alternate embodiment, the volume level selected by the 
subscriber represents a volume level to another piece of 
equipment such as an audio system (home theatre systnn) or to 
the television itself » In such a case, the volume can be 
measured directly by a microphone or other audio sensing device 
which can monitor the volume at which the selected source 
material is being listened. 

. A program change occurring while watching a selected 
channel is also logged by the system control unit 20O. 
Monitoring the content of the program at the time of the 
program chhnge cen be done by reading the content of the EDS. 
The EDS contains information such as program title, which is 
transmitted via the VBl. A change on the program title field 
is detected by the monitoring system and logged as an event. 
In an alternate embodiment, an SPG is present and program 
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information can be extracted from the EP6. In a preferred 
esabodiment, the prograjtimlng data zecolyed fran the BOS or BPG 
peiodts distinguishing between entertainment progtainming and 
advertisements. 

5 PIG. 3 illustrates an exemplary block diagram of the 

channel processor 210. In a preferred embodiment, the input 
connector 220 connects to a tuner 300 which tunea to the 
selected channel. A local oscillator can be used to heterodyne 
the signal to the IP signal. A demodulator 302 demodulates the 

10 received signal and the output is fed to an pec decoder 304. 
The data stream received from the PEC decoder 304 is, in a 
preferred embodiment, in an HPE6 format. Zti a preferred 
embodiment, a system demultiplexer 306 aeparates out video and 
audio information for subsequent deooii5>re88ion and processing, 

15 as well as ancillary data which can contain program related 
information. 

The data streaca presented to the system demultiplexer 306 
consists of packets of data including video, audio and 
ancillary data. The system demultiplexer 306 identifies each 

20 packet irom the etream ID and directs the stream to the 
corresponding processor. The video data Is directed to the 
video processor module 230 and the audio data is directed to 
the audio processor 240. The ancillary data can contain 
dosed-captioning text, emergency messages, program guide, or 

25 other useful iatomation. 

Closed-captloning text ia considered to be ancillary data 
and is thus contained in the video stream. The eystem 
demultiplexer 306 accesses the subscriber data field of the 
video stream to extract the olosed-oaptioning text. The 

30 program guide, if present, is carried .on data «tream identified 
by a specific transport program identifier. 

In an alternate embodiment^ analog video may be used. For 
analog programming, ancillary data such as closed-cap tionlng 
test or EDS data are carried in a vertical blanking interval. 
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FIG. 4 illustrates an dxeorttplary block diagram of a 
computer system for a realization of the subscriber monitoring 
fiystera illuat rated in PIG. 2. A system bus 422 transports data 
amongst the CPU 203/ the KAM 204/ a Read Only Memory - Basic 
5 Input Output gyetem (ROM-BIOS) 406 and other components. The 
CPO 203 accesses a hard drive 400 through a diaX controller 
402. The standard lnp\it/output devices ere connected to the 
system bus 422 through the x/o controller 201. A keyboard Is 
attached to the Z/0 controller 201 through a keyboard port 416 

10 and the monitor is connected through a monitor port 418 « The 
serial port device uses a serial port 420 to communicate with * 
the I/O controller 201. Industry Standard Architecture (ISA) 
expansion slote 408 and Peripheral Component interconnect (PCI) 
expansion slots 410 allow additional cards to be placed into 

15 the Gonputer. In a preferred ^odimentr a network card is 
available to interface a local areai vide areai or other 
network. 

PIG. 5 illustrates a channel sequence and volume over a 
twenty-four (24) hour period associated with advertiaement 

20 . selection record llOA or subscriber selection record HOB. The 
Y-axis represents the status of the receiver in terms of on/off 
status and volume level. The X-axis represents the time of 
day. The channels viewed are represented by the windows 501- 
505, with a first channel 502 being watched followed by the 

25 viewing of a second channel 504 , and a third channel 506 in the 
morning. In the evening a fourth channel 501 le watched, a . 
fifth channel 503, and a sixth channel SOS. A channel change 
is illustrated by a momentary transition to the ""off status 
and a volume change is represented by a change of level on the 

30 Y-axia- 

A detailed record of the advertising selection record llOA 
and/or programming selection data llOB is illustrated in fig, 
6A in a table format. A time column 602 contains the starting 
time of every event occurring during the viewing time. A 
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Channel ID column 604 list* the channela viewed or visited 
during that period. A title column 603 contains the tities of 
programs /advert isementB viewed. A volume column 601 contains 
the volume level at the time of viewing ^ selected channel. 

Generally, the advertlBement selection record llOA and/or 
program selection record llOB are unprocessed data arid 
conprlsee the data associated with irrelevant or 
Inconsequential activities, e.g., channel surfing, channel 
junplng, or dead activities. Thus, before the aubeotiber/ 
houaehold viewing habits are determined, the raw selection data 
is filtered to eliminate the data associated with irrelevant 
(inconseqaential) activities such as channel surfing, channel 
jumping, or dead period activities. It la to be noted that raw 
selection data refers back to advertisement aeleotion records 
llOA and program selection records llOB. 

As illustrated in PIG. 6B, the channel surfing relates to 
an activity wherein the subscriber rapidly changes channels 
before, arriving at a channel which may be of interest to hlni. 
During the channel surfing period, the viewing time of each 
intermediate channel is very brief, e.g., less than one minute. 
In this viewing time, the subscriber briefly glances at the 
channel programming, and then moves on to the next channel. 

One or more filters of the present Invention are 
configured to filter -out the surfing activity and only the 
actual viewing activity la considered in the actual maXe-up of 
household viewing habits. For example, In FIG. 6B, the viewing 
record illustrates that the viewing time of each of the 
channels 2, 3, 4, 5 is lees than a minute, however, the viewing 
time of channel 6 is about an hour. Filter 115 of the present 
invention evaluates this record, and then removes the 
oorresponding viewing times of channel 2, 3/ 4f 5, from the 
viewing records. The viewing time of channel number 6 is kept 
as it is not indicative of the channel surfing, .but an actual 
viewing. 
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Similarly, the viewing record aldo Indicates that the. 
corresponding viewing tlmea of each of channel numbers 1$ 9, 
58^ 57^ 56r 55, 54, 53 are a3>out a minute or lead. fhiB 
ioipliee that after the dubacriber had completed the viewing of 
5 channel nomber 6, the subecrlber once again eurfed the channels 
to find a programming of interest at channel 25, which was 
viewed for about 10 minutes. 

riG. 6C illustrates processing involved in the elimination 
of viewing times associated with the channel junking 
10 activities. iThe channel jumping activity is different than a 
channel surfing activity in a sense that the subscriber- already 
Xnows the intended programming (and corresponding channel 
. number) he wants to watch, and utilizes the channel up or 
channel down button to arrive at the intended channel* 
15 The viewing time of all the intermediate channels during 

channel jumping activity are generally very brief {less than a 
second) • Also, as the channel up or channel down button is 
utilized to reach the desired channels, generally, there exists 
an upwards or a downwards stream of channel change a f i.e.; the 
2D subscriber may jump through channels 2,3, 4 and 5 to reach 
channel number 6 (an intended channel) . Similarly, sul^scriber 
jumps may through channel 7, 9/ 10, 11/ 12, 13r 14, 15, and 
16 to reach channel 17, 

The filters of the present Invention are configured to 
25 eliralnate the channel junq^lng tfata from the actual viewing 

data. Filters generally evaluate the associated viewing times, 
and all the viewing times which correspond to channel justing, 
e.g.f are less than one eecond, are removed from the viewing 
records. 

30 The filters are also configured to eliminate data 

' associated with dead activities, e>g., extended spans o£ 
inactivity. These extended spans of inactivity indicate that 
the subscriber is not actively watching the programming, e*g., 
the subscriber has left the room, has gone to sleep, or is 
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Otherwise engaged in soma ofcber Activity. These spans of 
Inactivity may he determined by evaluating chAnnel change 
coratnands, volume change commandfl, or other program aeleotion 
comraanda iesued by the subacriber. For example, if the 
5 evaluation of the viewing record indioatee that, the subscriber 
has not issued either of the channel change, volume change, 
on/off, or any other program selection command in last three 
hours, it is aaaumed that subscriber is in an inactive 
condition, and the remaining viewing time of that viewing 
10 session ie not fionsldered In the make-up of the household 
viewing habits. The spans of inactivity may be caused by any 
number of reasons. For example, it is generally known that 
subscribers often do not turn their televieions (or other 
multimedia sources) off before attending to some other 
15 activities, e.g. cooking in the kitchen, running to the nearby 
grocery store, or going to basement for a work-out. 

inie filters of the present invention are constantly 
filtering out the irrelevant inEorwation associated with the 
channel surfing activities, channel jumping activities, or with 
20 the periods of inacUvity, so that the data used for generating 
. household viewing habits is more illustrative of the actual 
viewing habits. The actual subscriber selection data is then 
used to create household viewing habits. 

A representative statistical record oorresponding to the 
25 household viewing habits is illustrated in HG. 7. In a 

preferred enbodiment, a time of day column 700 is organiaed in 
period of time including morning, mid-day, afternoon, night, 
and late night. In an alternate embodiment, smaller time 
periods are used. A minutes watched column 702 lists, for each 
30 period of time, the time in minutes in which the SCSF 104 
• recorded delivery of programming, the number of channel 
changes during that period and the average volume are also 
included in that table in a channel changes column 704 and an 
average volume column 706 respectively. The last row of the 
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statiatlcal reoprd contains Uie totala for tha. items Usted in 
the minutes watched column 702, the ohannel' changea column 704 
and the average volume 706. 

PIG. 8A illuatratea em entityrelafcionahip diagram for the 
5 generation of th© charactexistlca vector 150. The context 
vector generation and retrieval technique can be applied for 
the generation of th© charaoteriatica vectora 150 which ia 
described in OS Patent 5,619,709. Other technigoes are well 
knovm by those skilled in the art. 
iO The source material 130 or the SPG 140 ia passed through a 

characterization proceaaing 800 to generate the oharacteriatics 
vectors 150. The characterization pioceesing 800 is described 
in accordance with FIG. 8B. The content deacriptora Including 
a first content descriptor 802, a second content deaoriptor 804 
15 and an nth content descriptor 806, each classified in terms of 
the category, the sub-category, and other divisions as 
identified in the industry accepted program classifioation 
system, are presented to a context vector generator 820. As an 
ej»n^le, the content descriptor can be text representative of 
20 the expected content of material found in the particular 

category (program and/or advertisement ) . In this example, the 
content deocriptors 802, 804 and 806 would conUin tent 
representative of what would be found in programs in the hews, 
fiction, and advertising categories respectively. The context 
25 vector generator 820 generates -context vectors for that aet of 
aan^le texta resulting in a first aummary context vector 808, a 
second auiumary context vector 810, and an nth aunuwry context 
vector 812, In the example given, the summary context vectora 
808, 810, and 812 correspond to the categories of news, fiction 
30 and advertising respectively, The sumrory vectors are stored 
in a local data storage system. 

A sanple of th© source related text 136 which is 
associated with the new program to bo classified is paesod to 
the context vector generator 820 wMdi generates a context 
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vector 840 for that program. The dource related text can be 
either the source material 130/ the BP6 140/ or other text 
associated with the source material 130. A coeoparison is made 
between the actual program context vectors and the stored 
5 program content context vectors by computing, in a dot product 
COTiputation process 830, the dot product of the first aumnvary 
context vector 808 with the context vector fi40 to produce a 
firat dot product B14. Similar operations are performed to 
produce second dot product 816 and iith dot product 818 • 
10 * The values contained in the dot products 814, 816 and 818, 
while not probabilistic in nature, can be expreaaed in 
probabilistic terms uding a aimple transformation in which the 
result represents a confidence level of assigning the 
corresponding content to that program. The transformed values 
15 add up to one* 1?he dot products can be used to classify a 
piTogrami or form a weighted sum of classifications which 
results in the characteristics vectors. In the example given, 
if the source related text 136 waa from an advertisement, the 
nth dot product 818 would have a high value, indicating that 
20 the advertising category was the most appropriate catecfory, and 
assigning a high probability value to that category. If the 
dot products corresponding to the other categories were 
significantly higher than zero, those categories would be 
aesigtaed a value, with the result being a program 
25 oharaoteristios vector 150 as shewn in FIG. 9D. 

For the sub- categories, probabilities obtained from the 
content pertaining to the same sub-category are suiwaed to form 
the probeijility for the new program being in that sub-category. 
At the sub-category level, the same method is applied to 
30 coir^jute the probability of a program being from the given 
category. The three levels of the program classification 
system; the category, the sub-category and the content, are 
used by the charaoterizaticn processing 800 to form the 
characteristics vectors. 
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The program charaoteriotios vector? 150 in genaral are 
repraBdntad in FIGS. 9A through 9F. FIGS. 9B and 9C are an 
exan^le of datermiaistio vectors. Ifhia set of vectora ia 
generated when the program charaoterlatica axe well defined, aa 
5 can occur when the source related text 136 or the BPG 140 
contalna epeclfic fields Identifying the category and the aub- 
category. A program rating can also provided by the BPQ 140. 

In the caee that these characteristics are not specifiedf 
a statistical set of vectors is generated from the process 

10 described in accordance with FIG, B. PIGS. 9D-9F Illustrate 
the probability that a prograrn being watched ia from the given 
category and program classification, respectively. 

FIG. lOA illusitrates sets of logical heuriatics rules 
which form part o£ the heuristic rules 160. In a preferred 

15 embodiment/ logical heuristic rules are obtained from 

sociological or psychological studies. Tw types of rules are 
illustrated in FIG. lOA. The first type links an individual's 
viewing characterieticd to deitiographic character let ice such aa 
gender, age^ and income level. A channel changing rate rule 

20 1030 attempts to determine gender baaed on channel change rate. 
An income related channel change rate rule 1010 attempts to 
link channel change ratee to income brackets. A second type of 
ruled linka particular programs to particular audience, as 
illustrated by a gender determining rule 1050 which links the 

25 program category/sub-category with a gender. The result of the 
application of the logical heurletic rulea illustrated in FIG. 
IDA are probabilietic determinations of factors including 
gender^ age, and income level. Although a specific set of 
logical heuristic rules has been used as an examplOr a wide 

30 nuiiftber of types of logical heuristic rules can be used to 

realise the present invention. In additionr these rules can be . 
changed based on learning within the system or based on 
external studies which provide more accurate rules. 
FIG. lOB illustrates a set of the heuristic rules 
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expreesed in tertns of conditional probabilities. In the 
©xajt^le ehown in FIG. lOB, each of several categories have 
associated conditional probabilities for demographic factors 
such as age, income, faroily size and gender c<w>poaltion. 
5 PIG. 11 illustrates an entity-relatlonehip diagram for the 

generation of the demographic vectors 170. In a preferred 
embodiment, the heuristic rules 160' are applied along with* the 
characteristic vectors 150 in a target analyela process 1100 to 
form the demograiAlc vectors 170 , The characteristic vectors 
10 150 Indicate a particular aspect of a program, such as its 
violence level. The henrtatic rules 160 indicate that a 
particular deaographio group has a preference for that program. 
As an example, it may be the case that young males have a 
higher* preference for violent programs than other sectors of 
15 the population. Thua, a program which has the obaraoteristic 
vectors 150 indicating a high probability of having violent 
content, when combined with the heuristic rules 160 indicating 
that *young males like violent programs, " will result, through 
the target analysis process 1100, in the demographic vectors 
20 170 which indicate that there is a high probability that the 
program is being watched by a young male. 

The target analysis process 1100 can be realized using 
software programmed in a variety of languages which processes 
mathematically the heuristic rules 160 to derive the 
25 demographic vectors 170, The table representation of the 
heuristic rules 160 illuetcated in FIG. lOB expresses the 
probability that the individual or household is from a specific 
demographic group based on a program with a particular 
category. This can be expressed, using probability terms as 
30 follow *the probability that the individuals are in a given 
demographic group conditional to the program being In a given 
category". 

Expressing the probability that a program is destined to a 
specific deiftographlc group can be determined by applying Bayes 
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r\)le. This probability Ib the sum of the conditional 
probabilities that the demographic group likes the progrent, 
conditional to the category 144 weighted by the probability 
that the program ie from that category 144. In a preferred 
5 eoibodiinent, the program target analysis can calculate the 
program demographic vectors by the application of logical 
heurietio rules 160, aa illustrated in WIG. lOA, and by the 
application of heuristic rules expressed as conditional 
probabilities as shown in FIG. lOB. Logical heuristic rules 
10 can be applied using logical programming and fuzzy logic using 
techniques well understood by those sXilled in the art, and are 
discussed in the text by S. V. Kartalopoulos entitled 
^Understanding Niural Networks and Fuwy Logic." 

Conditional probabilities can be applied by simple 
15 mathematical operations multiplying program context vectors by 
matrices of conditional probabilities. By performing this 
process over all the demographic groups, the target analysis 
process 1100 can measure hov likely a program is to be of 
interest to each demographic group. Those probabilities values 
20 form the demographic vector 170 represented in FIG, 12. 
As an exanple, the heuristic rules e^cpressed as 
conditional probabilities shown in FIG. lOB are used as part of 
a matrix multiplication in which the program characteristics 
vector 150 of dimension N, suoh as those shown in FIGS. 9A-9F 
25 Is multiplied by an M x M matrilt of heuristic rules expressed 
as conditional probabilities , such as that shown in FIG. lOB. 
The 'resulting vector of dimension H is a weighted average of 
the conditional probabilities for each category and represents 
the household demographic characteristics IdO. Similar 
30 processing can be performed at the sub-category and content 
levels . 

PIG. 13 illustrates an entity-relationship diagram for the 
generation of household session demographic data 1310 and a 
household seasion interest profile 1320. In a preferred 
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embodiment, the actual eubflcrlber selection data 159 is used 
along with the program characteristics vectors 150 in a session 
characterization procesB 1300 to generate the household session 
interest profile 1320. The actual aubsoriber selection data 
5 199 is based upon oae or ©ore advertisement selection records 
and indicates which advertieemente the subscriber is watching, 
for how long and at what volume they are watching. Similarly, 
the actual subsociber seleotion data 199 also indicatea which 
programs subscriber is watching, for how long and at what 
10 volume they are watdiing the program. 

In a pref erred . onbodiment, the session obaraot'erization 
process 1300 forms a weighted average of the program 
characteristics vectors ISO in which the time duration the 
program is watched ie normalized to the session time Jtypically 
15 defined as the time from which the unit was turned on to the 
present) . The program oharaoteriatios vectors 150 are 
multiplied by the normalized time duration (which is lass than 
one unless only one program. has been viewed) and sunwued with 
the previous value. Time duration data/ along with other 
20 subscriber viewing information, is available from the 
subscriber selection data llOA and llOB. The resulting 
weighted average of program character 1st ies vectors 150 forms 
the household session interest profile 1320, with eaph program 
contributing to the household session interest profile 1320 
25 according to how long it was watched. The household session 
interest profile 1320 is normalized to produce probabilistic 
values of the household programming interests during that 
session. 

In an alternate embodiment, the heuristic rules 160 are 
30 applied to both the actual subscriber selection data 199 and 
the characteristics vectors ISO to generate the household 
session demographic data 1310 and the household sdssion 
interest profile 1320. In this embodiment, weighted averages 
of the characteristics vectors 150 are formed based on the 
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actual aubscriber selection data 199| and the heuristic rules 
160 are applied. In the caae of logical heuristic rulee ae 
abovm in PIG. lOA, logical prograioming can be applied to make 
determinations regarding the household session den^graphic data 
$ 1310 and the household session interest profile 1320, In the 
case of heuristic rules in the form of conditional 
probabilities such ea those illustrated in tlQ. lOB, a dot 
product of the time averaged values of the program 
characterietics vectors 150 can be taken vitb the appropriate 
10 matrix of heuristic rules 160 to generate both the household 
. seaslon demographic data 1310 and the household session 
interest profile 1320. 

Volume control measurements which form part of the 
subscriber selection data llOA and HOB can also bB applied in 
15 the session characterization process 1300 to form a household 
session interest profile 1320. This can be accomplished by 
using normalized volume measurements in a weighted average 
manner similar to how time duration is used. Thus, muting a 
show results in a aero value for volumsi and the program 
20 characteristics vector 150 for this show will not be averaged 
into the household session interest profile 1320. 

FIG. 14 illustrates an entity-relationship diagram for, the 
generation of average household demographic characteristics 190 
and session household demographio characteristics 190. A 
25* household deniographic characterization process 1400 generates 
the household demographic characteristics 190 represented in 
table format in PIG, 15. The household demographic 
characterization process 1400 uses the household viewing hablte 
195 in combination with the heuristic rules 160 to determine 
3D demographic data. For exan^le/ a household with a number of 
minutes watched of zero during the day may indicate a household 
with two working adults. Both logical heuristic rules as well 
as rules based on conditional probabilities can be applied to 
the household viewing habits 195 to obtain the household 
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dembgxaphlcs characAeristics 190. 

The household viewing habits 195 is also used by the 
system to detect out-of -habits events. For exaaple, if a 
household with a zero value for the alnutee vatched column 702 
5 at late night presents a session value at that time via the 
household session demographic data 1310, this session will be 
oharaoterlzed aa an out-of-habits event and the system can 
ftKOludfi suoh data from the average if it ia highly probable 
that the demographics for that session are greatly different 
10 than the average denographids for the household. Nevertheless, 
the results of the application of the household demographic 
oharaoterization prooefls 1400 to the household session 
demographic data 1310 can result in valuable sessiOD 
demographic data, even if such data is not added to the average 
15 demographic characterization of the household. 

PIG. 15 illustrates the average and session household 
■ demographic characteristics 190, A household demographic 
parameters column 1501 is followed by an average value column 
1505, a session value column 1503, and an update column 1507. 
20 The average value column 1505 and the session value column 1503 
are derived from the household demographic oharaoterization 
process 1400. The deteminlatic parameters euch aa address and 
telephone numbers can be obtained from an outside source or can 
be loaded into the system by the subscriber or a network 
25 operator at the time of Inatalliation. Opdating of 

deterministic values is prevented by indicating that these 
values should not be updated in the update column 1507. 

FIG. 16 illustrates an entity-relationship diagram for the 
generation of the household interest profile 180 in a household 
30 interest profile generation process 1600. In a preferred 
embodiment, the household interest profile generation prooess 
1600 comprises averaging the household session interest profile 
1320 over multiple sessions and applying the household viewing 
habits 195 in combination with the heuristic rules 160 to form 
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the household interest profile 180 which takes into aooount 
both the viewing preferences of the household as well as 
aBsunptlons about households/subscribers with those viewing 
habita and program preferences. 
5 PIG. 17 illustrates an exemplary household interest 

profile 180 that includes a programming types row 1709, a 
products types row 1707, a household interests column 1701, ao 
average value column 1703, and a session value column 1705. 
The product types row 1707 gives an indication as to what 
10 type of advertieeinent the household would be interested in 
watching, thus Indicating what types of products could 
potentially be advertised with a high probability of the 
advertisement being watched in its entirety. The prograiratiing 
types row 1709 suggests what kind of programming the household 
15 is likely to be interested in watching. The houaehold 

interests column 1701 specif iea the types of pregrajiroing and 
products which are atatistioally characterized for that 
household. 

ha an example of the industrial applicability of the 
20 invention, a household will perform its normal viewing routine 
without being requested to answer specific questions regarding 
likes and dislikes. Children may watch television in the- 
morning in the household, and may change channels during 
commercials/ or not at all. The teleyiaion may rwnain off 
• 25 during the working day, while the children are at school and 
day care, and be turned on again in the evening, at which time 
the parents may *eurf" channels, mute the television during 
commercials, and ultimately watch one or two hours of broadcast 
prograimting. The present invention provides the ability to 
30 characterize the houaehold, and may make the determination that 
there are children and adults in the household, with program 
and product interests indicated in the houaehold interest 
profile 190 corresponding to a family of that. c««posit ion. A 
houaehold with two retired adults will have a conpletely 
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different oharacterizatlon which will be indicated in the 
household interest profile 180. 

Slnoe a viewing seflsion is likely to be dominated by a 
paxticvdar viewer, the aeasion values toay, in some 
5 circurastanoes, correspond most closely to the subscriber 
values, while the average values i»y# in aome circumatances, 
correspond iftoat closely to the household velues. The average 
value being a time average of data, where the averaging period 
nay be several days, weeXs, months, or the time between reset* 
10 of unit.. 

Although the present invention has been largely described 
in the context of a single computing platform receiving 
progrannding. the AMFS 100 can be realized as part of a client- 
server architecture, as illustrated in PIG. 18. Residence 1800 
15 contains a personal computer (PC) 1820 as well as the 

combination of a television 1810 and a aet-top box 1808, which 
can request and receive programming. The equipment in 
residence 1600, or siidlar equipment in a small or large 
buBiness enviromoent, forms the client side of the network as 
20 defined herein. Programming is delivered over an access 
network 1830, which may be a cable television network, 
telephone type network, or other access network. Information 
requests are made by the client aide to a server 1840 which 
forms the server side of the network. The server 1840 has 
25 content locally which it provides to the eubeoriber, or 

requests content on behalf of the subscriber from a third party 
content provider I860, as illustrated in fIG. 18. Requests 
made on behalf of the client side by server 1840 are made 
across a wide area network 1850 which can be the Internet or 
30 other public or private network. Techniques for making 
requests on behalf of a client are frequently referred to a 
proxy techniques aad are well known to those skilled in the 
art. The server side receives the requested programming which 
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is displayed on PC 1820 or television 1910 according to which 
device made the request. 

According to one'eiDbodimnt, the server side maintains the 
advertising selection data IlOA and subscriber selection date 

5 HOB which it is able to contpile based on its operation as a 
proxy for the client side. Retrieval of source related 
inform^ition 130 , the program target analysis process 1X00, the 
prograni characterization process BOO, the aessicn 
characterization' process 1300< the household demographic 

10 characterization process 1400, and the houssbold interest 
profile generation process 1600 can be performed by server 
1840. 

Referring to PIG. 19 an advertisement monitoring table is 
illvstMted, in which an advertisement ID (AD ID) column 1915 

15 containd a numerical ID for an advertisement which was 

transmitted with the advertisement in the form of a Program ID, 
http address, or other identifier which is uniquely associated 
with the advertisement. A product column 1921 contains a 
product description which indicates the type of product that 

20 was advertised. A brand column 1927 indicates the brand name 
of the product or can alternatively list a generic naioe for 
that product. A percent watched column 1933 indicates the 
percentage of the advertisement the subscriber viewed. In an 
alternate embodlmentf a letter rating or other type of rating 

25 is used to indicate tho probability that the advertisement was 
watched. A volume column 1937 indicates the volume level at 
which the advert iseroent was watched. 

As an example of the industrial applicability of the 
Invention, a manufacturer may develop an advertising strategy 

30 which includes the insertion of advertisements during popular 
evening programs. The costQ for such ad insertions can be 
extremely high. In order to insure the coat effectiveness of 
this advertising strategy f the manufacturer has the 
advertisements placed during less watched but similar programs 

43 



5/4/05, EAST Version: 2.0.1,4 



wo 01^5747 PCMJSH/D64S9 

and monltoxs how subscribers reacts and can determine 
approximately hottf many times the advertisement has been watched 
out of all of the possible viewings. This data can be used to 
confirm the potential effecativeness of the advertisement and to 
subsequently deteraine if purohaetng the more eitpenalve time 
during evening programming will be co8t**effective; or if the 
advertlseiRent should be inodified or placed in other 
programming. 

Continuing this exanple, the manufacturer may place an 
advertisement fot viewing during ""prime time*^ for an initial 
period but can subsequently cancel broadcasts of the 
advertisement if it is found that the majority of subscribers 
never see the advertisement. 

Although this invention has been illustrated by reference 
to specific embodiments/ it will be apparant to those skilled 
in the art that various changes and modif icatiites may be made 
which clearly fall within the scope of the invention. The 
invention is intended to be protected broadly within the spirit 
and scope of the appended claims. 
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What is olained iat 

1. A method for gyrating a sidssorlber profile based on 

advertlssnents watcbed by tha subsoriber, the method 
5 oosiprislng: 

raonitoriag Bubeoriber advertising viewing activities; 

colleoting advertisement aeleetion data from the monitored 
subBpriber adrextising visviag activities; and 

generating a subscriber profile based on the advertisement 
10 selection data. 

2. The itiethod of claim 1^ further comprlBlng retrieving 
advertisement related infonnation for advertisements Identified 
in the advertisement selection data wherein the advert ieement 

15 related information containa deaoriptlve fields related to the 
advartlEementE . 



3. Th« method of claim Z, wherein said retrieving 
includes context mining text associated with the 

20 advertisements. 

4 , The method of claim 3, wherein the text Is derived 
from closed-captioning data associated with the advertisement. 
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5. The method of claim 3, wherein the text Includes a 

product nane field. 



6. The method of olelm 3, wherein the text inoludee a 
5 product bxand field, 

.7. The method of olala 1, wherein said monitoring 
eubecriber advertleing viewing activities includes monitoring 
volume levels. 

10 

8. The method of claim 1, wherein said monitoring 
eobBoriber advertising viewing activities includes monitoring 
diannel change requests by the stdasoriber. 

15 9. ■ The method of claim 1, wherein said collecting 

advertisemeat selection data inoludee determining the extent to 
which on ftdvertisejnent is viewed by the subsoriber. 

10. The method of claim 1, wherein the subscriber profile 
20 is a subscriber ptoduot interest profile. 

11. The method of claim 1, further includes: 

monitoring subscriber program viewing aotlvltiee; 
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collecting program selection data for the monitored 
subscriber program viewing activities; 

Mi»bining the prograni eelection data with the 
achrertlaentent selection data; 

5 evaluating the combined program selection data and the 

advertisement selection data to filter out irrelevant data and 
. generate a record of actual subscriber selection data; and 

proceeaing the actual subscriber selection data to create 
the subscriber profile • 

10 

12. The method of claim 11, wherein said monitoring 
subscriber program viewing activities includes monitoring 
viewing time durations for selected source material. 

15 13. The method of claim 11/ wherein aaid evaluating the 

combined program selection data includes evaluating channel 
change commands and aeeociated viewing times. 

14, The method of claim 13, wherein aaid evaluating the 
20 combined program selection data inoludea filtering out any 
channel change coimoands if the aeeooiated viewing times are 
below a pre-determined threshold* 
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15. Hhs method of olaim 14, wher«ln the filtered out 

channel change connands coriespond to ohaimel aurflng 
activities. 



5 16.' The method of olaim 14, wherein the filtered out 

diarmel change commands ooxrespond to channel jiunping 
activities. 

17. The method of claim- 11, wherein said evaluating 
10 includes evaluating viewing tiaea and filtering out any viewing 
period* if no subacriber activity has been received within a 
pxe-'detexadned period of tine. 



18. The method of claim 17, wherein the filtered out 
15 viewing perioda eorreepond to dead periods implying that the 

Bubsoriber la not actively watching a televiaiwi or other 
multimedia device. 

19. The method of claim 11, wherein the subsoriber 

20 profile ie a program preference profile for the eubecriber, the 
program preference profile indicating the type of progranroing 
of interest to the sobeoriber. 
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20. The metbod of claim 11/ wherein the subscriber 
profile 1& a prodhict preference profile for the avbsorlberr the 
product preference profile indicating the type of products of 
Interest to the eubscrlber, 

5 * 

21. The method of claim II, wherein the subscriber 
profile ia an advertising preference profile for the 
subscriber/ the advertising preference prof lie indicating the 
type of advertieing of interest to the subscriber. 

10 

22. A data processing syot^ for generating a subscriber 
profile based on advertisements watched by the subscriber, the 
system ooitqprising: 

a storage medium; 

15 means for monitoring subscriber advertising activities; 

means for collecting advertisement selection data for the 
monitored subscriber advertising activities; 

means for retrieving advertisement related information for 
ads in the advertisement selection data, wherein the 
20 advertisement related information containe descriptive 

fields corresponding to the advertisements/ 

means for determining the extent to which the 
advertisements are viewed by the subscriber; and 
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means for generating a dxibscribex profile baaed on the 
advertisement related Information and the ext«it to which the 
advertisements are viewed* 

5 23. The eystem of clalat 22, wherein the nteans for 

monitoring subscriber activity includes means for monitoring 
volume levels vhereln the volume levels correspond to 
subscriber selection volume levels. 

10 24. The system of claim 22, wherein the means for 

monitoring subscriber activity Ineludes meana for monitoring 
channel change requests initiated by the aubsoriber, 

25. The system of claim 22, wherein the means for 

15 retrieving advertisement related information includes means for 
context mining of textual information assooiated with eelecfced 
source material. 

26. The system of claim 25, vhereln the teictual 
20 information is text derived from olosed-captioning data 

associated with the advertisement. 
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27. The system of claim 2$, vherdln the test deciyed from 
closed-captionlng data aesociated with the advertlaentent 
inoltides a psoduct nane field. 

S 29. The system of olain 26, whexeln the text derived from 

olosed-captioning data aasociated with the advertiaement 
includes a product brand field. 

29. The system of claim 22, further con?)rislng: 

10 means for monitoring subscriber program viewing 

activitlesf 

means for collecting program e^lectlon tiata for the 
monitored subscriber program viewing activities; and 

means for combining the advertisement eeleetion data and 
15 the program eeleetion data. 

30. The system of claim 2$, further comprising: 

means for filtering out irrelevant data and generating a 
record of actual eubecriber selection data; and 

20 means for processing the actual subsck'iber selection data 

to create a subscriber profile. 
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31. Tha system of claim 22, whoreln the subdcriber 
profile i9 a program preference profile for the aubscriberr the 
program preference profile indicating the type of prograsttidng 
of interest to the stibscriber. 

5 

32 « The system of claim 22| wherein the subacriber 
profile 19 a product preference profile for the subscriber, the 
product preference profile indicating the type of products of 
interest to the subscriber, 

LO 

33 « The* system of claim 22/ wherein the subscriber 
profile is an advertising preference profile for ths 
subscriber r the advertising preference profile indicating the 
type of advertising of interest to the subscriber* 

15 

34. A client-server baaed data processing system for 
generating a subscriber prof ile based on the advertiseinents 
Watched by a subacrlberi the client-server based data 
processing system comprising: 

20 computer processor means at a client side for receiving 

and displaying advertisanenta and transmitting channel change 
requests) 

ccHnputer processor means at a server side for receiving 
the channel change requests and for processing data; 
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a storage xsiedlum; 

means at the server side for laoaitorlng aubscriber 
activity including receiving aubacriber channel change regueata 
and atoring aubacriber channel change requesta; 

5 means at the server aide for retrieving advert iseinent 

related infomation wherein the advertiaement related 
information contains descriptive fields corresponding to an 
advertiaement; 

means at the eerver side for determining the extent to. 
10 which, an advert iaemant is viewed by the aubacriber; 

meane at the server side for storing the descriptive 
fields and the determination of the extent to vhich the 
advertisement is viewed by the subscriber; and 

means at the server aide for processing the descriptive 
15 fields and the extent to which the advertisement is viewed by 
the subscriber information to generate subscriber profile. 

35. The system of claim 34, wherein the meana for 
retrieving advertisement related information further conprises 
20 means for context mining of textual information asaociated with 
the selected source material. 
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36 # The dystem of claim 35, wherein the textual 
information is text derived from closed^captionit^g data 
associated vith the advextiaement. 



5 37. The aysten of claim 36| wherein the text derived from 

doaed-oaptioning data aaaoclated with the advertisement 
includea a product name field. 

3&. The aystem of claim 36, wherein the text derived from 
10 cloaed-captioning data associated with the advertisement 
included a product brand field, 

39. The syatem of claim 34, further ooniprising: 

means for monitoring aubecriber viewing activitiea related 
15 to actual programming; 

means for collecting program selection data based on the 
actual programming! and 

means for combining the advertisement selection data and 
the program selection data. 



20 



40 » The system of. claim 34, further comprising } 

means for filtering out irrelevant data and generating a 
record of actual subscriber selection data; and 
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means fox processing the actual aubscxibdr eelectlon data 
to create a aubscriber profile. 



4a. The system described in claln 34, wherein the 
5 subscriber profile is a progrsua preference profile for the 
subscriber, the program preference profile indicating the type 
of progranuaing of interest to the subscriber. 

■ ' 3 • 

42. The eystem of claim 34/ wherein the subscriber 

10 profile is a product preference profile for the subscribetf the 
product preference profile itidicatlng the type of products of . 
interest to the subscriber. 

43. The system of clsim 34, wherein the subscriber 
15 profile is an advertising preference profile for the 

subscriber^ the advertising preference profile indicating the 
type of advertising of interest to the subscriber. 
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